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ABSTRACT 

The Colorado Evaluation Project was funded to field 
test the Common Status Measures concurrently with Colorado's pilot 
program in assessment and evaluation. The primary purpose is to 
determine Colorado's educational needs^ and the secondary purpose is 
to test procedures for assessment which can be replicated or adapted 
by local school districts or other States. These activities have been 
completed: (1) developing test items; (2) building test forms; (3) 
drawing a sample of pupils; (4) hiring and training test proctors; 
(5) administering tests; and (6) keypunching data. A description of 
these activities^ resultant products, and problems encountered is 
provided. Some 12,000 tests were administered to a random sample of 
students in 31 districts across Colorado. The Common Status Measures 
were administered to 1,030 fourth- and eleventh-graders in Colorado. 
Tests in six subject areas were given to determine whether certain 
curricular objectives are being met. (Author/KM) 
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Forewo'^d 

Field work is complete for testing the Common .Status Measures con- 
curreni.ly with Colorado's pilot program in assessment and evaluation. 
Some 12,000 tests were administered to a random sample of students in 
31 districts across Colorado. The Common Status Measures (CSM)^ admini- 
slered earlier to a nation-wide sample, were administered to 1,030 fourth 
and eleventh graders in Colorado. Tests in six subject areas, developed 
by Colorado teachers and consultants, were given to determine whether 
certain curricular objectives arc being achieved in Colorado. Prior 
field testing of the CSM is described in a report of the United States 
Office of Education, dated December 1969. 

Cooperating in the project are Dr. Robert Heath of Stanford University 
and director of Pacific Educational Evaluation Systems, who is directing 
technical operations; Dr, Gene Glass oC the University of Colorado, who is 
advising on item development; members of the Colorado Department of Education, 
who planned and carried out the statewide ar>sessnicnt program; and the Belmont 
Group, who supplied interest and support throughout the entire project. 

Analysis of data is under way by the Pacific Educational ^valuation 
oystcms of Stanford, California. This analysis will be directed toward 
our common purpose - to determine f-ducational needs in Colorado. 
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A PROGiUiSS ilKPORT ON 1*HE 
COLOKAIX) EVALUATION PilOJECT 
(Cotninon Status Measures) 

On the following pages are a review of the purpose of the project, a 
description of activities completed, problems encountered, and a plan for data 
analysis. Documentary material may be found in the Appendices. Further i n- 
fornaiion on the CocsRion Status Meastires is available in a report prepared for 
the United States Office of Education dated December 1969. 

The Colorado Evaluation Project was funded to field test the Common Status 
Measures concurrently with Colorado's pilot program in assessment and evaluation. 
The primary purpose was to determine Colorado's educational needs, defined herein 
as "the discrepancy between stated objectives and their achievement." A secondary 
pttrpose was to tost procedures for assessment which can be replicated or adapted 
by local school districts or by other slates. 

The project has completed these activities: (1) developing*, test items, 
(2) hujldinj^, test forms, (3) drawing n sample of pupils, (4) hirinf* and training 
lest proctors, (5) administering tests and (6) key punching data. A description 
of these activities, resultant produces, and problems encounterpd is given below. 
Developing Test Item s 

The Common Status Measures used in this project were, with minor revision, 
those used in the Comprehensive* Evaluation Project completed in 1969 (U.S.O.E. 



Contract ^EC.O-9~090017-4424(01C). Basic verbal slatnK and occupation;?] 
cOf',n3zance are measured by these items. The development ot C.S^r-, items is 
described in the finnl report of that project dated December 1969. 

Colorado personnel developed the other items used in the project, 'Hiese 
test items were desip,aed to determine whether certain ciirricular objectives 
were being achieved in Colorado. Development took place over a one-year period 
and consisted of five general phases, as explained below. 

Wriiini,^ objectives . Consultants, representing several subject disciplines, 
met in a week-long work confenmce to write objectives. Used as the basis of 
these objectives was Goals for Education in Colorado , a document authorized by 
the Colorado State Board of lulucation in 1962* For example, from the general 
goal of 

"Adequate opportunities for all persons to acquire command of ' 
knowle^j^eT^ki 1 Is, habits, and attitudes essential for effec- 
tive learning throughout life ..." 

was derived this more specific objective: 

"The pupil will apply his ability to use parts of a book with 
facility as measured by an exercise directing t.he pupil to 
locat.e and use the following parts: (a) Title page, (b) Table 
of Contents, (c) Glossary, ami (d) List of illustrations " 
( Third Grade Language Arts ; objective No. 24 , ) 

Specifications for objectives provided that each contain these elements: 

(1) the subject toward which attention was r.o be directed, i.e., "the ptipil," 

(2) the behavior sought, i.e., "will apply his ability to use." (3) the 
content, i.e., "parts of a book," and (4) a meas\irinp device, i.e., "an 
exercise ..." 

The consultants wrote objectives for learning, in several subject disci- 
plines appropriate upon the completion of kindergarten, grades 3, 6, 9, and 
12» Numbers and types of objectives are indicated in the table below: 
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TABLE I 

Nunber of Obj«BCtivef; Written 
in Grade Levels and Coatent Areas 



Li^ ve 1 


Health 


P.E. 


~Matb 


l^n^uage Arts 


So i pn **** 


Tot cx 1 


K 






8 






22 


3 


28 


12 


10 


21 


12 


85 


6 


27 


15 


17 


14 


10 


83 


9 


17 


26 


16 


22 




81 


12 


15 


26 


14 


21 




76 


Tot als 


87 


79 


65 


78 


36 


345 




Music objectives were written some 


time after the work 


conference for 


the 


satnc 


five grade levels 


as for 


other subject disciplines. 








Defining content 


areas. 


Tlie nbjectWes statec in the 


various subject 





disciplines were put in broader context by construction of a three-dinicnsional 
Kodcl (see Appendix A). The objectives were represented on one d intension of 
the model - tbnt dimension identifying, common program offcrin^^s in Colorado 
school s, 

A second dimension of the model identified basic educational otitcome*; 
derived from Goals for, Education in Colorado ^ In this way, general and specific 
aspects of the content to be assessed v;ere related visually. 

A third din^nsi on of the inodel identified l)ehaviors souf,ht by the student, 
Tbese behaviors were classifier! according to the cognitive, affective, and 
pi;ycho-tnot or domainK as developed by Bloom and others. 

Thus, conicnt areas were defined in a way which suftf^estcd possibilities 
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(1) for i lenudcve lopment , and (2) for conslrucrinf hvpo*be5Jcs on '^ducr.t ) onal 
neO(^. Wi Lh i he defirition of tl-ese content areas. )t was proposed *hnt 
sanpljnfi procedures be employed to select pupils and Lo select itcras to assess 
learniPf^ in \hc contrni areas so (defined, 

Judfuni; objectives . Task Torrr r^etibcrs inspected the objectivps for 
cr»nsjstcncy with specifications anti then *Mibmi i ted lists of objectives to a 
sample of teachers jn Colorado for j'idrjaent . Object ivcs which were acccptal le 
to teacher;; were tised ; those- ^naccep* able to teachers v;crc di scardei^. 

I'or example, the Objec-ive for Third Grade Languarce Arts statc<i above 
wrs deened •V^f*,-./ i*.p'^r { aut*' b/ 41.4% of the teachers sapipled, "important" by 
47,1% of the teachers sampled , **Mniniportant** by 6.0% and "very iininjpor taiil'* 
by 1,1% of the teachers (3.5a not respondi Finding that 88.5% of the 

teachers sampled deemed this objective "important** or "very important." the 
'fa<?k Force indged the objective lo be acceptable as a basis for assessment 
ancf eval'inM'on of learninj^^ in Colorado. 

Fro <hici n «' ? < ems^ Consultant's, retained to write objective s--referenced 
jtems, mei in a thre<-day traininj^ session. Presented were concepts of face 
validity and iJem satnplin*^. Stressed were differences ]>etween nnrw-rcf erenced 
and objectives-referenced itetns. Objectives-referenced items, the consultants 
werf» told, need not (1) predicr future success of the pupil, (2) correlar.e with 
other abilities or general intelligence, or (3) be bard for some and easy for 
others. However, such items should discriminate between those who can and 
those who can't do wh.:it is specified in the objective. 

Items were developed io assess achievement :n the content areas defined 
jti phase 2, To assess achievement of the third grade lanc^uage arts objective 
statp'i above, the following', itetns were produce*!: 
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Below Are tbrce pai:es from a hoo^ * '^ho noxi' ^uo questions will be. about thera. 



JoiiM an(^ Jean rin 
to t ho i''nriii 



'i'A!U.E OK coNiTN';':; 






ILLMS'INATTON.S 




Chapter 


Paj'.c 




1 . Jean Gc( s 


1. Pack) MO 


4 




Uo' ... 


10 


2. A I'JCUK- , . 


9 




2. The P\y,s 




3, Seeinj; the 






Kai ... 


13 


Animals , . . 


12 




5. A Pa) 1 




4, Milkjru' the 






Falls Over 


17 




15 








5. Walkinr^ in the 










Fields ... 


J9 









0. The title of the book is: 



a) John and Jenn Go to the Farm 

b) Packinj^, 

c) Jean Gei s Wet 

d) No title is ?uven 



5. a) o 

b) a 

c) o 

d) o 



(>. On which paRe of the book doe^j "Seeing the Animals** start? 



a) 2 

h) A 

c) 12 

d) 13 



0. a) o 

b) o 

c) o 

d) o ' 



Tlie content aiea which these items assess may be located on the model of 
variable.*; jn AppendJx A: (I) Program offering is **reading/* (2) Basic edu- 
cationnl outcome was **abiUty to read rapidly with conprohcnsi on /* and (3) 
Student l)ehavior elicited is in the **co[^ni I j ve** domain. 

Judging feasibility . Time constraints modified the nunbers and types of 
items which cotild be use<I. With the end of the school year fast approaching, 
tnojil items which had hee.n constxtirted in the affective and psychomotor domains 
wpjc set aside, for future tise, 
Uuildinr^ Test Forms 

Subjl'e ct matter t ests . For each Language Arts, Science, Math, Physical 
Kdncatjon, and Health, five test forms were made for each applicable grade 
level. The test forms were constructed by CDE and PEES personnel. 



lii^r.} pools (Irveloped by rhe Colorado Department of iiducation CCDE) were 
supplied for each snhjeci and parade level (.see Colorado's ftem Developmen t 
oect ion ). After reviewing ihe itens and taking, into account titne constraints 
eslablished for lest admj ni st u on . a decision was made as to how many items 
should bp assigned to each form. An iie.m x test form matrix was then completed 
by assigning te^i i»em.s to test forms for each subject through the use of tables 
of random permutations. PEES personnel did this item sampling. 

In some cases, a &roup of items was related through reference to a read- 
inf^ passa?,e. In these cases, the items were grouped in a block, and the block 
was randomly assigned to a test form. Every item in the item pool was assigned 
to at leas' one test form. 

The music test construe lion did not follow the pattern outlined above. 
Tlic music test items x^yere not assigned to various forms. The test involved 
li*:tcning to audio tapes. Therefore there was only one test form for each 
applicable iirac^c level, 

Comnon status measures . The saitie forms, with minoti revisions, contained 
ui the Final Report of the Comprehensive Evaluation Project (U.S.O.E, Contract 
^EC.O-0>099017^4424(010) December 1969) were used. Common .Status Measures in^ 
eluded Basic Verbal and Occupational Cognizance tests* There are six test 
fortas for each test for the fourth and eleventh grade levels. 

Pupil characlerisr ic it.etits . A pupi) characteristic questionnaire was 
included with each test form. At the secondary level, the pupil was instructed 
to complete the form. At the eleraentary level, the proctor was instructed to 
aid the student in fillinj^ out the form and to verify the responses with the 
assistance of school records. The questionnaire asked the students to indicate 
hiS or her sex, race, father's occupntion, and if a second lanj^uage was spoken 
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-fif =^V\e home. A copy, of t he _i>.upii cji^ nH*^^-^-U*nnaix^^^ is ^nciudec) 

i l^^vi:ngc:ai;Samp^ 

K£ . Srudentf p^^ iri: th§ assessment q jet t were selected by 

l^ndoSizing p^^ This entailea random Reject i schools^,. 

cl^s0§> 3inj5r^_\}t^^^^ lP|ES ^pg&sgirie^^ samf ^ i *dureSi 

^ ^gll^cj^ i on 6X ^^l £lr: ^ c ts^^^^^ ^^iJSj random sa|^^^ were usgd. 

t|: sel« (iisiflcts repr^se^^ _aH .diltri^^^^^ in eptqtMp. SpecigicaQ^ 

atr 3i s t|icf s^ wre XiS^'gJ W 9r4sr of size of pu^ti .Jnrjgllgen^^^^ 

sp llej^ f i St ar t ih^^^ th4^ s^tles|:,, ,was_ selj ectiC 

^/ a samgli §jg$ rXct. 5f tj^ !|l:^lgX. Mstglcts^.^JM^dlst 
^^fec Ep _ in^^ t^^^ _ ScKoql^_DXS^^ _No X J( Den ver^ was^ad d^^ n|e pendjg^Iy 



tgffilXsl- ^ig aij se o f th^at 4is^ X-io^tal b? .31: districts 

^^^^c^gQ^3i^4^^^j^^^ggjg4^^e^ \ -~ ^^^^ r 

^ SglecMonz^fe^Sch^^^ Schl&pls w>jel l^ljBcf^d r^M^S ff6jn 

SMfeficM., Bp^ contained^ aW |chqol_|. in the - ^ _ 

dj^:tr\icj-^eg^ f|g ?S||gier^s^^^^ ag|/4^t3 rM . 

^ej ec tyofL tri^ cfasses> _ Cl asse s^ within schpql^ M^jB. Mlec ted randon 



^^U'^Mg i itef dey^^^ These :safi^ classes were tested., Ixceptipns wep<^ 

^fef §: tte teacjSef^^^^^ in the jud||emint of pyectiveA i^re 

^||clui][5 those ^;^^yde or suujejcts V.o he asisesiied. Jn the; se cases,. pUier closes 
^^e chps|in by tbe^^^ 4lo^i lar 

^EME^ ions Were made where no fceapher^s. in the schpol or district .pa^^^ 
pn? jiidgeffien t of pl>3e$:tiA^ 

ff\ Selection of s t tide htj_ . Test pro_ctpr.s_ were assigned the task of selecting, 
§:tudents from classrooms to take the various tests. The test proctors 6btairt|d 
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^ class rosier from; th^^^^ of iraridbm numfiees, tKe^^ 

^ : _ selected the appropriate nuiWf r of studenfes^ to lake a. particular test otf 4es.ts. 
. Of ten > ^pprpy juufl^l^ ^! cl^si fepcHc:^ t two siib^^:fr 

, ^' .le the other sh^Vf ^t;po^ EvejM^n 

\_Z- ^^^ih Spcurreli:, the student^: ^aifigrvi^ tage Me y&iiipu^;.^^ tti^fiselec^ted 
l^jiat ran^Qlftsr No less: thatt:?^^ :or JS^ 
^ T ? ^^^^t^^!^ '^ixae;^ ~ ' -- _ _ _ 

I 7_ school^ V Weir a^^siltance^^^^ it i^s: (166^^ the bufclen pLJ 

^^gdSTMgi^r a jvoEs^^ a §i iS^M_#5 5^15^15^^^ ^fttvc tWsj w ^^fe ^ 

f - l^lfc&Wg^ ifr thcE 1^ nj^fi ^itefrogo HSam grea^: BMgeiiprroct^rs^i^^ 

" 4 . _ S^- ^ ^ ad>tj n isEf^ Mfig tesp 3 1 re i^^^ ted, 

r i 7 VgPtrp idmim vsSer^^- p^the^?^tgfts^:atr ^ty\e^^gcl|Si^^^/4®e1^. IfTconfa^ipr^^^^ 

\ r ^:Worke<^ in ^irs. Si^^jf^gt^rf: pf^^ a<1mir^tef^ 

) vfe ^^s:i=s^ at 

; ^peciaPlag|d in^tgiigttpns^^e^ deMil^^^§:f ^ :each groy pfcoctprSv. ^^Jgese: 

tract >^ne Ajg^pus sch(^ ^^endix 

_T , ^ ?U fiainin^ ,, ?6he l^vices^ pt a^ traini^§^ ^^cirgj^s t C r PEES: we rc tai^cV 

5 \ <t?i£ect4M a firtV^^^ ^he sessa^n was 

I - on May 1, 1970 In Denver;^ of the igfcpctprs^^v^^ 
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'J'he session bej'^an with introductory remarks which explained the 
purposes and nature of the program. These remarks ejiphasized the critical 
function played by the proctors in selecting pupils, and in test administration. 
Followinr, these remarks, administrative details were covered. Then the proctors 
broke up into the followin,'^ groups: 

JL. ilural proctors 

2. Denver Metropolitan Secondary proctors 

3. Denver Metropolitan Elementary proctors 

4. Denver Metropolitan Elementary proctors for Music only 

One member o£ the training stafC was assigned to each group. The staff 
members then conducted a training session tailored to the particular needs of 
their <^roup. Schools were also assigned to the proctors-during this training 
sessi on. 

Later in uhe 6e/, the proctors who hnd been trained for the administration 
of the elementary music tests, trained the secondary and rural proctors for 
music test admj nistrai ion. lliey were aided in this task by the training staff. 
The main differences between the music testing and the other tests were that 
the music test involved the use, of tape recorders, and the test was not broken 
into five test forms. 

A final full group session was conducted to covc-»r items s«jch as procedures 
for picking up and returning testinr n.aterials. Any remaining questions were 
answered. Proctors were paid twenty dollars per day, plus mileage. 
Adminif^tering Tests 

Administration of tests took place l>etween May 4 and May ?2. Arrangements 
were tailored to the situations found in the 206 different schools participating 
in the project. A description of these arrangements follow. 
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iililiJl' "'^^^ i^tiJsic lest was adui m .stored in a different roon so ^hat the 
fsoMnd of I l:e music tape, would not disitad the others, 'T\w. special music 
proctor ad'ni pis tered these cesls in jIic elementary schools. Iti ihe secondary 
schools, ihc music tesi was administered by cne of the team who also assunied 
various other proctor ing duties, 

{\Ji^ The physical education tests required some additional work on the 
part of the proctors. Some of the items determined if the individual could 
meet AAHPIiiR standards for a given performance task. Proctors were directed to 
enlist the aid of school officials in obtaining school records to ^^t the in« 
formation necessary for answering, these questions. 

Kinder|;;arten , One proctor was used for all kinder[;ar ten testinf.. The 
proctor randomly selected ten el(Maentary schools from a master list of all 
elementary schools involved in the sampling in the Denver, Adams-50, and 
Jefferson R-1 districts. At each of the ten schools, ten kindergarten pupils 
were randomly selected from the alphabetic class roster. The proctor arranj^ed 
to take individual pupils to a separate classroom or office to adtninister the 
tests. Kach pupil was jtiven one form of the math, test and one form of the 
science test, T!ierefore, form:; A through E of both tests were adninistered 
tv;ioe at each school - a total of twenty fort.is. A total of two hundred t.esls 
v;ere adi-iini st crcd in the Detiver urban area. 

Ach ievetaetU . tests . The objectives-referenced and Cotmnon Status Measures 
wore ^'ivtiti during, the same testinf; pcriix? in the schools. Numbers of sMKienrs 
lakjuff these test.'j is shown b( low accordinf^ to subject and [*,rade levels. 



- 10 



Numbers of Students Taking Tests 
According to Subject Areas and 
Grade Levels in Metro Schools 

Subject Areas Numbers of Students in Grade I/evels 

K 3rd 4th 6th 9tK* Uth * 12tK* 

C.S.M. 5 15-28 

Health 5 5 10-16 

Language Arts 0 5 10-16 15-2a 

Hath 10 5 5 10-16 15-28 

Husic 5i 5 10-16 15-20 

H- 5 5 10-16 15-28 

Science 10 5 5 10-16 15-2i 



*Numbers vary According to school enrollment 
As shown above each test was administered lo five, students in grades 3, 
4, and 6. Some students took more than one test. For example, five third 
nrade students took both Health and Language Arts, while five others took Math 
and P. Five others took the Science test. Generally the five fourth graders 
takinij the C.S,M^ joined the fifteen third graders taking the achievement tests, 
liach student took a different form of the test: one form A, the next form B, 

and <io on. ^ 

t) 

Ninth, eleventh and twelfth graders were grouped in similar fashion as 
for the elementary achievement tests. The groups, Iiowever , were larfter. 

Arrangements . Tests were administered in empty classrooms, lunchrooms, 
offices, auditoriums, or other space available at the time of the testing. 
Testing schedules were shifted to meet space requirements in several instances. 

Testing schediiles for the various schools were developed in cooperation 
wi Ih scbool officials. Letters to district superintendents were followed by 
phone calls to building principals to make the ar ranp,ements for testing 
described above. Normally, in the Denver MetropolH an area, two schools a 
day were visited by each elementary and secondary proctor team. 



bpon arrjviiif at a school the test proctors checked/ in with school 
admini 5l ralive personnel. The proctors were told which classes were to be 
tested and which rooms were available for testing purposes. The proctors 
lhe.n selectee? students to participate. (See ''Selection of Students'* above) 

Rural testing . Matrix .sampling*, was used to assign subject areas for test 
inp, to schools and districts whose pupil enrollment was less than 2500 (sec 
Appendix J)). All subjects were tested in schools located in districts with 
a pupi^ enrollment larger than 2500, The total number of students taking the 
various tests was based on the pupil enrollment in the district. 

Test accounting , A packet was prepared for each school involved in the 
testing program. Allocation of tests to a school was noted on a 5 x B card 
and recorded on a master accounting sheet. The 5 x B card also contained (a) 
name of school, (b) district, (c) principal's name, (d) address^ (e) school 
phone number, (f) ^»,rades to be rested, '(g) st^bjects to be tested, (h) numbers 
of pupils to be tested. rhe_proctt)rs returned completed test forms to the 
departtiKjnt. and this was noted on t!ie niaster accounting sheet. Upon checking 
the school packets, some were found incomplete; in these cases, where possible 
proctors returned to the schools for make-up testing. Approximately 95% of 
all tests allocated were finally completed. 

Keypunching . Tests were boxet! according to school packet and sent to 
PEKS at Stanford, California for key punching. Content of the data cards may 
be foumi in Appendix F, 
Problems Encountered 

Certain unforeijcen problems arose during the course of the Colorado 
Evaluaiion l^roject; These problems pertained to scheduling, selection of 
classes and pupils, answer keys, proctor identification, item development , 
and staff development so others may profit from our experience, the problems 
are described along with su^^gestions for their avoidance. 



Schedulir4r,« Due to the lateness of testing in the school year, I2th 
graders in several hifXh schools were out Cor the year and therefore missed 
taking; the tests. The testing was to measure ycfir-end learnin^^s; however, 
in the lai.ter part of May scheduling hi^h school seniors takes consideration 
as to their early leaving. Future efforts should consider dates of school 
closinj^, for 12th graders to be somewhat earjier than for other grade levels. 

Selection of classes . Uniform random procedures ar<c essential in select- 
ing classes if bias is to be prevented in drawing, the sample of pupils, l^.tters 
e>:plainjnR random procedures to school principals should have preceded the test- 
ing, by approxiijiately one week instead of relying on recall of teachets who had 
participated previously in the judgment of objectives. The letters may explain 
concepts of randomization, as well as the exact procedures involved. The 
letters may also provide a form for lif> ting, teachers whose classes may be 
sampled along with the page of random numbers for selection of the teachers 
whose classes are to participate. 

Selection of pupils. In some instances, proctors were unable to follow 
pure randomization procedures because of decisions by school personnel in 
providini. students for testing. Careful monitoring of the s^-udent samplini^ 
procedure is a necessity, 

Answ(*r keys . An answer key should be developed concurrently with assip^n- 
nn{ iicAHs to forms, Needlcijs time wa^ spent goinf, back through the five forms 
1 1) mairh q'lestioDS with t bo orij^inal tutnibers to find the correct answers from 
the orij'.inal answer key. 
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Proctor identification ^ Sonte phone calls cotild have been avoided if the 
proctors had badges or letters of identification. School personnel would call 
the Colorado Department askin'g for identification of ihe proctors if the principal 
was not at the school when the proctors arrived. Written identification could 
have avoided these calls. 

Item development » Achievement items should have been piloted before sub- 
uiission to a statewide sample in order to correct problems of language level, 
clarity and administrative feasibility. This piloting could have been done on a 
classroom basis in schools contacted by CDE personnel. 

Staff development . Objections about assigning items to forms could have - 
been avoided by gaining understanding as to the technical requirement?: of multiplo- 
m;;trix sampling. Concepts of item sampling should have been developed among CDE 
staff along with the development of objectives and items. 
Analysis of Data 

This project was funded to field test Common Status Measures in the State 
of Colorado concurrently with that state's pilot program in assessment. The 
analysis of the data will be directed toward a determination of educational 
needs in Colorado* Plans regarding the schedule of operations and the use of 
findings are described below. 

Lists of results . Listings of t lie proportion of correct, incorrect, and 
omitt«>(l responses to each individual t,est item will be presented on these units 
uf observation: The school, district, and total State. Such listings wiU not 
be for public release as they do not in themselves constitute comprehensi!)lc 
documents. These lists would be used by the State Department personnel: (a) to 
compute percentage of rettjrn of tests, and (b) to compare with other test in^ 
formation collected unc>r Colo. •<cv* St. 123-39-2 and other state laws. 
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Con t inc.ency ial?les , A secoru' opcralion will provide numerous cross- 
tabulations of responses to items nccor<^ini* to sevp.ral sub-Rroups identified 
in the rf.encraK school population and tbe total school population, A hypo- 
thetical table t^Jvinp; such, a cross-tat^ulai ion follows: 
(Hypothetical Data) i^esponses to i tern ff2 of the 



Grade 3 Health Test 

Sex All 
Ma Ic Fema le . Omi tted i<espondent?> 





No, 


_% 


No. 


% 


No, 




No. 


c 




Correct 


180 


86 


150 


65 


12 


80 


322 


75, 


8 


Incorrect 


20 


9 


53 


29 


2 


13 


80 


13, 


8 


Omi tted 


10 


5 


12 


6 


1 


7 


23 


5, 


4 


Ail -Responses 


210 


49.4 


200 


47.1 


15 


3.5 


425 


100, 


0 



Index of item difficulty . Alont^ with proportions of correct, incorrect 
and omitted responses, a sinf;lc index of item difficulty will be tabulated. 
We will examine item difficulty mcastirements for students in the following 
catep;ori ;;ations ! urbnnism, Title 1 target school, Title tIT innovative program 
school, by school district, sex, race, whetncr or not another languaf^e is 
spoken in the home, the father*s occupation. This more refined analysis can 
!h: used to examine questions such as whether the students in Title \ tars^et 
schiiols perform significantly different from those uho attend schools with 
.similar demof^rapbic characteristics btil without Title i programs, 

\ le a n ; ; c c s t i nun 1 c . The ai".aiyf>is outlined abovr is based on individu;il 
itiMuji. U'r.i^rditig pupi 1 performance, a mean score estimate will be F,3vcn for 
each of the various sub-t',roups indicated in item tf5 above. Also a mean score 
estimate for all students by subject by grade will' be given for the entire 
school population on all item;: for each subject within a Riven tirade level • 



This analysis will indicate whether or not H^cre are certain ^^xoups whose level 
of perforoiancG is significantly deficient. Onc'e needful groups are identified, 
ec'Ucational planners can begin to make appropriate changes to remedy the situation* 

indicators of test quality . The quality of tests themselves is, of course, 
an extremely important piece of information. How test results can bv. used for 
planning is based on reliability and validity of the tests* Therefore, an item 
hy item correlation for each subject for each grade level will be performed, 
oubjcc* by subject correlation (for example, the correlation of math and science) 
within grade levels and subject by Common Status Measure for adjacent grade 
levels will also be performed • 

Other operations . Data collected in Colorado on the Common Status 
Measures will be compared with similar data collected on a national sample. 
The analysis will indicate how the Colorado schools compared with nation-wide 
results. 

Also, examples of object ive-referenced items will be drawn to illustrate 
problems and correction of these problems. Logical consistency with goals and 
objectives, appropriate language level and other problems of the assessment 
will be so documented. 

Finally, preliminary inspection of the findings will be undertaken to 
identify areas of educational need. For each academic subject, every test item 
corresponded to an explicit educational objective. Given adeqtiate item-performance, 
the analysis described above will indicate which objectives are or are not bein?^ 
achieved in Colorado. The discrepancy between a stated objective and its achieve- 
ment will define educational need in Colorado* 
Use of Findings 

Reports of the 1970 Colorac^o Evaluation project will be aimed at two 
distinct and non-over lappiitg atidiences. First, technical reports of procedures 
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and findings will be presented in Statistical Tables with a minimum of verbal 

explanation. This report will be made available to professional staff of the 

Colorado Departn»ent of Education. 

Secondly, a Narrative Report will give a journalistic account of the program 

and the more salient features of the statistical table. This will be distriluited 

to the general public, including teachers, administrators, parents, members of 

» 

the State Legislature and other interested parties. This report may be used by 
thei»e persons (1): to help plan for needs identified in the report and (2) to 
replicate the procedures or adapt them for use in local districts or other 
states. 

ihirdly, a video tape explaining, several aspects of the testing will 
accompany the final written reports. Included in the tape are analysis and 
interpretation of data from the testing, description of various vocational 
education activities in ^rade 11, description of pupils sampled, and recom- 
mendations along with related interviews and classroom activity. 
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APPENDIX A 



CONTENT AREA/ 



Sampled l>y Ohj' t ives-Ref erenced It.ems 



Figure ] 



OVKRYIJ-r.V OF VAUTAnj,KS 



Basi.c Kchicai iojial Ouicoyncii' 

1. Knowh^d^M: oi .SciiMicc info, skill.n, coiicC])tj?. 

2* Knc)\v]ccl^\c of M.'iilicrn.'iticr. info, .skiJls, cojUH'y»Li;. 

3. Kno\v)(;cljic: of Social Stu<!ic;?: iufo, i;killr>, concc]>l*;. 

4. Ability to rc-ini rapidly with c:onij>r chcnr,ion. 

5. Ability lo commvtnicalc in Writinj',. 

6. Ability lo fJpcl] correctly. 

7. Kno\vlcclj^^<! :i}>prcc;i;i! !oji of ^'lirsic. 

8. AbiJijy to draw ajid to £\])j.r<'ciaU' Art. 

9. Knowlod^'c of lloajlh skills ajul concopt?;. 

10. Phy.*;ical y>roricicncy. (S already bcing^nica.'uirod) 

11. Proficicjicy in and knowlcdj'.c of llomc Economics. 

12. Proficioicy in and kno\vlcid[^c of one or more Lulustrial Arts, 

13. Cognizance of 'Occupational Opportunities. 

14. Interest in School, School Subjects, and Education. 

15. Value of Self, Family, Society. 

16. Ability and initiative to solve real and i^rcssing problems. 

17. Ability and desire to i'>articipale in group work. 



10 11 12 13 14 15 16 17 




Program 



Stiuk-nl }^ 

A. Coj'jiitivc 
P.. Aifcclivc 
C. l^Kyc-.hojuotor 



\ 

CJ — 



ERIC 



Jn the Context of-- 
Studcnt and family information: 
Age/Sex/Kace or Ethnic Origin/Enrolled in tin.*; 
<;chool-3 years ago/Second language v/hon in home/ 
I. Q. /Occupation of head of housi-hold/Education 

of mother. 





Cvn*ricular : 




a. 


Science 






Math 


a 


c. 


Social Studies 


b 


d. 


Reading 


c 


c. 


Eng. Comi^., Grammar, lAt. 


d 


f. 


Spelling 


c 


g- 


Music 


f 


h. 


Art 




i. 


Health, Safety, Recreation 


g 


j- 


Physical lOducation 


h 


k. 


Home Economics 


i 


1. 


Voc. Ed / Industrial Arts 


j 
k 


m. 


Foreign Languages 


1 


Co- 


curricular: 


m 


n. 


Guidance 


n 


o. 


Health 


o 


P- 


Psychological 


P 


q. 


Social 


q 


r. 


Library 




s. 


Food 




i. 


Transportation 



District Denver 



Elementary Schools 



A Icot t 


Gold rirk 


Ash Grove 


Gust 


Ash ley 


Harrington 


Barre 1 1 


l^app 


We ] mont 


Lincoln 


Boetlcher 


McMeen 


Bradley 


Hon tbello 


Brown 


Montclair 


Carson 


Munr oe 


Colfax 


Palnier 


Columbine 


Pitts 


Cory 


Rosedalc 


Crof ton 


Sabin 


Don 11 


5?hprnui n 


Ebert 


SfT.i t h 


Ellis 


Steck 


Elmwood 


Steele 


Enter SOI; 


Swansea 


Fa i r mont 


Thatcher 


Fa3 rview 


University Park 


Force 


Washington Park 


Gi Ipin 


Whi teman 




I'/yatt 


Junior High 


Schools 


Baker 


Kunsmi Her 


Byers 


Lake 


Cole 


Merrill 


Gove 


Morcy 


Grant 


lUshcl 


Hi 11 


Skinner 


Horace Mann 


Siiii ley 



Kepner 



Senior High School 

Abraham Lincoln 
East 

Gftorge WashinjMon 

John F, Kennedy 

Manuel 

Nor th 

Sotith 

Yhomiis Jefferson 
West 



District Jefferson i<-l 



ElemctUary Schools 



Al lendale 


Mar tenson 


uelmar 


Miller 


Central Lakewood 


Molholm 


Coal Creek 


Mountain View 


Columbine Hills 


North Lakewood 


Daniels 


Patterson 


Edgcwa ter 


Pennington 


Fairmount 


Prospect Valley 


Foster 


Red Rocks 


Frtiitdale 


Secrest 


Green Gables 


South Alameda 


Hackberry Hi 11 


Stober 


Ju:hem 


Vanderhoof 


lAsley 


Wei Chester 


Lutnberg 


West Jefferson 


Junior High Schools 


Alameda 


Evergreen 


Arvada 


Golden 


Bell 


Ken Caryl 


Belmont 


Lakewood 


Carmody 


Manning 


Creighton 


North Arvada 


Drake 


Oberon 


Dunstan 


West Jefferson 


Everit t 


I\/heat Ridge 


Senior High Schools 


Alameda 


Jefferson 


Arvada 


lakewood 


Arvada West 


Wheat '^.idr,e 


Bear Creek 


Kve rf;r€en 


Golden 





nisi rid Adams 5^0 Westminster 

Eleinent.ary Schools 

Baker 
Berkeley 
Clara Metz 
Grej;ory Hi 11 
Sunset iUd^e 
Tcnnysofi Knolls 
Westminster 



Jttnior Ihgh Schools 

Clear Creek 
Hodp.kJ ns 
Scot t Carpenter 
Shaw lleir.^is 



Senior Hi<^h- Schools 
Uanum 

Westminster 



District Adams lA 

1l le men t a ry Sch oo I s 

Central 
Dupont 
Rose Hill 
Oneida 



Junior High Schools 

Adams City 
Kearney 



Sen i o r Hi^,h Scliool 
Adams Ci ty 



District i\l Paso 2 

hlementary Schools 

Pikes Peak Park 
Stratnioor Hills 

Senior H igh School 
linrr J son 



District Adams 27J 
Elementary Schools 

Nor t he as t 
Junior H if h School 
Mor 111 Hri ghton 
Senior H i gh Sch.oo l 
Br i^;hton 

District Otero R^l . 
Elementary Schools 

Columbian 
Senior Hi^;;h School 

La Junta 

District Douglas Re^l 
Elementary Schools 

Castle Rock 
Junior High School 

Dour,las County 
S cni or Hi r,h Sch ool 

Douglas County 

District Weld RE>8 
Elementary Schools 

Leo l/tn, Butler 
Intermediate 

Fort Lupton 
Senior Hi^h School 

Fort Lupton 



District G unnison REIJ 
Elementary Schools 

Biackstock 
Senior High School 
Gunnison 

District Huerfano Ke-1 

Elementary Schools 

Washin^^t on 
Hill 

Senior Hi^h School 
Walsenburg 

District Clear Creek Re-l 
Elementary Schools 

Idaho Sprinj^s 
High School 

Idaho Springs 

District Uoutt Re-2 
liletnentary Schools 

Steamboat Sprinp.s 
Junior High School 

Steamboat Springs 

District Teller Re -2 
Elementary Schools 

Woodland Park 
Senior Hi[;h School 

Woodland Park 



District Larioier 
Elementary Schools 

Estrs Park 
High School / 

Estes Park 

District Baca Re->4 
Flemcntary Schools 

Spr inp;f ield 
Senior Hif^h 

Springfield 

District Dolores Re-1 
Elementary Schools 

Seventh Street 
Senior High 

Dolores County 

District Prowers Re-1 
Elententary Schools 

Granada 
High School 

Granada 

District Grand U(J) 
Elementary Schools 

West Grand 
High School 
V7est Grand 
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District Koutl Ke^l 
i!:lementai'y Sc>»onls 

Ison 
Ui gh School 
I lay den 

1)3 strict hJlbert 
inententarv Schools 

Elizabeth 
H ^gh School 

Flizabcth 

District Sar.uache Re-1 
Klementary Schools 

Mountain Valley 
High School 

Mountain Val ley 

!)3»stricl Alamosa Re-22J 
I. lementary Schools 

Sangre tie Cr is to 
lli>;h School 

Sangre fie Cr ) sto 

ni<<irict Park 1 

Plat If Canyon 
"i*. • U' C.invon 



ni strict Morgan Re-^O 
Kle^ meiU a rv ^choo I s 
We Id on Valley 
Hi<>h School 

We Id on Valley 

District Lnp^an Re*5 
Klementary Schools 

Peetz 
High School 
Peetz 

District Las Animas 88 
Elenientary Schools 

Kim 
H if^h School 

Kiui 

District Elbert C^2 
Klementary Sch ools 

Kiowa 
High School 

Kiov;a 

District Weld Re- 10 
ni^emen » arv ^ch oo 1 s 

i^r i *M^.sdale 
Hi^rh School 

lir ifU'StIa Ic 



District Washington 101 
rriemftn t a rv Sch o ols 
Lone Star 

I.onc Star 



A P P iJ N D I X C 



INSTRUCTIONS TO TEST PROCTORS 



ERIC 



PkOCTOR IN.S-r^UCTlON 



Df*nvcr - 12th Grac> Achievement and 11th Grade CSii 
A. You win have 3 cla5f*^rs of VAth f,radors! 

1. Yon will use all of 1 cla«s Tor J?th f^rade Maih and PK 

2. You will use all of another clas.s for 12th f^r;n^<* Health nnd 
Language Arts 

3. You will use all of a »hird clnss for Miisi.c 

n. You will have 1 class of 11th graders. You will uso all of this 
class for Hth grade Common Status Test, 

Note: When these tests are complete PEESS/CT)K will rnndomlv delate tests 
from the above classes to f,et down to the matrix num&er af^rced upon 
for testing.. 

Denver - 9th Grace Achi.evement 

A. You will have 2 classes of 9t.h fj,raders: 

1. You will randomly assign 15 or 16 students from 1 class to 9th 
grade Math and PE, 

2, You will randomly assign 15 or 16 of the remaining students from 
this class to Health and Language Arts. 

5, You will .randomly select 15 or 16 ninth graders from another class 
to Music. Take these st»idents to the music testing room. 

B. The random selection procedure you will use is as follows: 

1. Get a class roster of the classes you will be using. The students 
in t.he class should be listed alphabetically and numbered 
sequentially, c^.g., 1. Adams, 2, Kutts, 3. Glump ....40, Zotts. 

2. Use the attached table of random numbers to select the number of the 
student to take the test. Repeat the procedure until you have the 
total number of students you need, e.g. . 15 or 16. 

3. :>tart anywhere on the table. The first number is your first student, 
e.g., ^17, look on the class roster and the student listed as is 
your first student. Repeat this process !)y moving down the cobnnns 
until you have all the students you need. 

Note: If a number is repeated, skip ii and move t.o the next number. 

Also, if yoM reach a tuimber larger th«i » the class size maximtim, 
skip it and move lo the next number. 

4. Start t.he whole process over for each class, e.g, , 15-16 strjdcnts 
selected for Math and PK; 15-16 students selected for Health and 
Language Arts, and T'^-IO ijtudents for Music. 



PROCTOR INSTRUCTIONS 



Denver i^^cLropoli tan Klementary 

A. At each school you will test on*^ third ?rarie class usjng 15 students from 
that class. Select and assign the students as follows: 

U Randomly select 5 students for 3rd grade science and math 

2. Randomly select 5 students for 3rd grade lanj»uage arts and health 

5. Randomly select 5 students for 3rd grade physical education 

B. At each school you will test one 4th grade class using 5 students from 
that class. Select and assign the students as follows: 

1. Randomly select 5 students for the 4th grade Gotnmon Status Measures. 

C. At each school you will test one Cth grade class using 15 students from 
that class. Select and assign them as f' Uows: 

1. Randomly select 5 students for 6th grade science and math 

2. Randomly select 5 students for 6th grade language arts and health 

3. Randomly select 5 students for 6th grade physical education 

n. Random selection procedures arc as follows: 

1. Get a class roster of the classes you will be using. The students 

in the class should be listed alphabetically and numbered sequentially, 
e.J., 1. Adams, 2. Butts, 3. Clump ... AO. Zotts. 

2. Use the attached table of random numbers to select the number of the 
student to take the test. Repeat the procedure until you have the 
total number of students you need, e.g., 5 or 15, 

3, Start anywhere on the table, the first number is your first student, 
^.g.. No. 17, look at the class roster and the student listed as No, 
17 is your first student. Repeat thie process by moving down the 
columns until you have all the students you need. If a number is 
repeated, skip it and move to the next number. If you reach a number 
larger than *:he class size maximum, skip it and move to the next number. 

4, Start the whole procedure over for each class, i.e., 3, 4 and 6. 



PROCTOR INSTRUCTIONS 



Music Proctors - Denver Elenjentary Metropolitan 

A. You will have one class of 3rd traders. Select and assign rhem 
as follot;s: 

1. Randomlv select 5 stiidenis from this class for the 5rc1 j'rndc test 

■Si 

^V. You will hnve onr: class of 611: ;tpHc»-s. Sclcci and nssi^u^ ihem a.s follows 

I. Ramiomly select 5 stiulents from this class of Oth f.radors tn tnke 
the Clh j;rade tesl. 

C. Random selection procedures to be followed are: 



1. Get a class roster of the classes you will he using. The students 
in the class should be listed alphabetically ^and numbered 
sequentially, e.g., 1. Adams, 2. Butts, 3. Iciump ...AO Zotts. 

2. Use the attached table of random numbers to select the number .of 
the student to take the test. Repeat the procedure until you have 
the total number of students you need, e.g., 5, 

3. Start anywhere on the table, the first number is your first student, 
e.r,*» No* 17, look on t.he class roster and the student listed as No. 
17 is your first student. Repeat this process by movinf^ down the 
columns until you have all the /students you need. If a number is 
repeated, skip it and move on :o the next number. 

A. Start whole process over for each class, i.e., 3rd and 6th, 



PR(X;rOR i N .STRUCT XON s 



Paso - 9t.h tirade 

You will have two classes of 9ih i',ra<lcrs. Assign them as follows: 

1. Randomly select 15 stiulenJ.s from one class to r.ake math and 
physical education. 

2. Randomly select 15 sliulenis from those remaining, in this class 
to take health and langua^^n arts, 

3. From another class, randomly select 15 9th graders to take the 
music test.' 

Random selection procedures are as follows: 

1. Gel a class roster of the classes you will be using. The students 

in the class should be listed alphabetically and numbered sequentially, 
e.f^., 1. Adams, 2. Butts, 5. Clump .../^O. Zotts. 

2. i:.se the attached table of random numbers to select the number of the 
student, to take the test. Repeat the procedure until yon have the 
total number of students you need, e.f,., 15. 

5. Start anywhere on the table, the first number is your first student, 
e^g. , No. 17, look at the class roster and the student listed as No. 
17 is your first student. Repeat this process by moving down the 
columns until you have all the students you need. If a number is 
repeated, skip it and move to the next number. If you reach a number 
larger than the class si^e maximum, skip it and move to the next number. 

4. Start the whole process over for each class, i.e.: 

15 students for 9th grade math and physical education 
15 students for 9tb grade health and language arts 
15 students for 9th grade music 



PROCTOR INSTRUCTIONS 



Rural Areas 



A. Yo\j will be selecting studcnls in groups of 5, from any grade you are 
testing. Most frequently, these 5 students will be taking two tests 
during the testing period, e.g., n,ath and health or science and physical 
edttcation or health and lanp^uage arts. 

Music will always be f^iven separately from the other tests. 

B. At most, diirinp, any hour of testing, you will have 15 students in the 
testing room. 



C. Random sUident selection procedures to be followed: 

1. Get a class roster of ihe classes you will be using, the sttjdent-s 

in the class should be Ijsted alphabetically and numbered sequentially, 
e.g., 1. Adams, 2. Butts, 3. Clump ...40. Zotts. 

2. Use the attached table of random numbers to select the number of the 
student to take the test. Repeat the procedure until you have the 
total number of students you need, e.g., 5. 10 or 15. 

3. SI art anywhere on the table, the first number is your first student, 
e.g.. No. 17, look at the class roster and the student listed as 
No. 17 is your first student. Repeat this process by moving down 
the columns until you have all the students you need. If a number 
is repeated, skip it and move to the next number. If you reach a 
number larger than the class size maximum, skip it ami move to the 
next number. 

4. Start the whole process over for each class, i.e., 3, A, 6, 9, 11 
or 12. 



A PAGE OF RAi:nOM KUMEEP.G 



2;. 731 
701 iJO 

sosiy 

41014 
17'k:o 

2Ai',VA 
7'JS*K) 
7oSOI 

m2:) 

75153 
14102 

S171G 
4^31/1 

2 7:1 in 

SI7;>2 
2ti7uS 

S^Ol! 

01401 
5G0:,7 
oO!>l5 
40w31 

77;}:s0 



£ 

n2:!iM) 
OS r.?G 
323.Vi * 

2*r.v> 

2l>101 
31SI.J 
3I0»U 
4^rai 

i:>27:i 
701S3 

3<ino 

Stl';7G 

4'.»:i2v 
nob3 

1O700 
OJ7G0 
4<i3Mi 
7i,S.r> 
IVSI \ 
iJ7A'^3 

o:>072 
;r.02; 
*>377l 
5^in2 

.-.7 -w^ 

45^027 



5 

.'•.ISS! 
^7'J:.7 

.]fl.Vi 1 
.'iOi.'i 
10711 

i.n>v) 

2>730 
M30S 

*V1S73 

S0li7 

'/o::iv2 

72;()7 
7SSI4 

0'«1'2I 

:h*.710 
1 ;o2'j 

lS7i»0 
/Si 

;m)2oO 
i:r*io 

ONUS 



6r.2i7 
072:.S 
23123 
721G9 
41180 

:i3oii2 

75201 

oo:;'.i7 

03102 
1)211 
57t.VG 
UMV 
71127 

r,o:K,7 

13GG1 
71400 
5721 i 
OnoM 
40721 

.V2,^;3 

2;>n:>7 
105'J2 

84<i22 
3-J7.ll 
^*..Vi7!i 

s*o:i 

02ii'J4 



17r.23 

4^o:>i 

737U0 
riS:)7l 
OSasl 
45f.3'J 
0S832 
G5XV33 
776S0 
G7I2o 
S3:^(iS 
50102 
5272S 
4 IS73 
G73.'»2 
35370 
(HiOSl 
ojl7.'> 
21211 

$1 too 

7l'vOl 
301 •! 

1^^272 
7riOSl) 
GlJOl 
lG:i7i 
03-i.>2 

.12'/.!) 

a]ti3 

mGOO 
.I20(>t> 

1 1,^00 



C 

47141 

5- no 

17."»3I 

o'.orj 
8;ri2 

9Si/5 

^»^^)'^/ 

6^1G0 
»510| 

•:i.vjo 

! m'o 

: HOT 

on?.'; 

•^3:i:*o 

•jo:;2--. 
:2^.")0 

;i'0j2 

42.:.o.s 

/43;»3 

7'.»-. 

£2:!:'! 

:r,i2.'i 
3:»7.;» 

1/>l-5 
VS'-10 
5;i;r.< 

'.»:,.S53 



7 

27S21 
00111 

Or.vioo 

1»737? 
43i;Oi> 
2KbO 
90:100 
3>OS77 
00iil2 
71S20 
073'.12 
72(170 

oi/r.i 
2r;io7 

IfifiOU 
^77P7 
43jI'J 
74!H;7 

3:r>3<j 

.:iO,72 

12 12!* 
SS5:)3 
31320 

30:* > I 

? tri07 

2013-1 
<S0S7 

0; n5 

4;.2iO 

10130 

02747 



503 



APPENDIX I) 



MATRIX OF DISTRICTS AND SUBJECT AREAS SAMPIJiD 
(Place pages end to end for complete matrix) 
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APPENDIX 12 



PUPJL CHARACTEiaSTIC ITEMS 



Elementary School Pupil Characteristic Items 

Name of Student: 

School: 

Name of Teacher: . 

Da te : 

Time of Day: 

To the proctor: Please answer the following questions with the aid of 
the student and/or school personnel. The aid of school personnel in 
answering item number four may be especially needed. Pupil's records 
should be checked to verify his responses. 

1. What is this pupil's sex? 
( ) Male ( ) Female 

2. Indicate below if this pupil is a member of any of the following 
racial or national origin groups? 

( ) American Indian 
( ) Negro 
( ) Oriental 

( ) Spanish-surnamed Ajnerican (Persons of Cuban, Mexican, or 

Puerto Rican descent) 

( ) None of those listed 

3. Is a language, other than English, regularly spoken in the pupil's 
home? 

( ) Yes ( ) No 

4. In the box below, please write the usual occupation of the person 
who is the primary supporter of this pupil *s family. If you don't 
know, write "Don't Know** in the box below. * 



Please indicate below the most appropriate option describing the 
occupation you have written in the box above. 

( ) Farm worker 

( ) Farm manager or owner 

( ) Unskilled worker, laborer, or domestic worker 

( ) Semi-skilled worker 

( ) Skilled worker 

( ) Sales agents and representatives 

( ) Technical 

( ) Manager or foreman 

( ) Official 

( ) Professional 

( ) Don • t know 
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APPENDIX F 



Content of Data Cards 



ERIC 



Subject area 

Grade level number 

Form numbers - A, B, C, D, E» F 

School code number and district code number 

Ptipil responses to test items (3 to 30 items) 

Pupil characteristics : 

Student's name code 

Student's sex 

Student's national origin group 
Language other than English (yes or no) 
Occupation (10 classifications) 

Ti tie I school 

Title III school 

Neither 

Both 



